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We study the critical features of coupling parameter in the synchronization of neural networks 
with diluted synapses. Based on simulations, the exponential decay form is observed in the extreme 
' case of global coupling among subsystems and fully linking in each network: there exists maximum 

and minimum of the critical coupling intensity for synchronization in this spatially extended system. 
For the partial coupling, we present the primary result about the critical coupling fraction for various 
linking degrees of networks. 



04 ■ Synchronization of coupled complex systems has been an intensively studied subject since the pioneering work of 
Fujisaka B and others ||^. This phenomenon of synchronization is observed in many other fields, such as in neural 
networks^, in biological populations [|| and in chemical reactions 1^. Recently, spatially extended system has 
inspired great interest |Q. 

^ , Following the series of work contributed by Zanette |^ @ , we consider a simple modified version of the neural 
J-j ■ network model described in As a very important ubiquitous factor corresponding to real biotic neural systems, 
* the neural activity and morphology of synaptic connectivity i.e. the dilution of neural networks must be introduced 

. | pO| . That is, in natural neural systems, not all the neurons are linked together. So, there is a chance to investigate 
"j^ \ the critical features of coupling parameter and the function of structural topology in synchronization of extended 
. systems. 

I ' We consider a neural network model that consists of N analog neurons Xi (i) £ [0, 1] , z = 1, . . . , N . Each neuron 
'■^ . Xi is connected with other neurons Xj by a random weighted coupling Jij. Obviously, the connecting matrix J is 
^ asymmetric and the neural systems exhibit complex spatial oscillations. As a simple version of coupled neural systems 
O _ designed by Zanette we use the parallel dynamics for the updating neurons: 
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^ ; Here h'^{t) is the local field of the z-th neuron and is expressed by 
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' where Cij G {0,1} is used to denote the linking status between the i-th neuron and the j-th neuron. The dilution 

"j^ factor Cij is independent identically distributed random variable. It is selected by 

S I if z < d, then Cij = 1; else Cij — 

(— I where z £ [0, 1] is a random number and d G [0, 1] denotes the linking degree of networks. The activation function 
Q I (r) is defined as 8 (r) = [1 + tanh(/3r)] /2. In there, (3 = 1/T characterizes a measure of the inverse magnitude of 
O ' the amount of noise affecting this neuron, acting as the role of reciprocal of temperature in analogy to thermodynamic 
^ ' systems. For convenience, we set [3—10 through all simulations. 
• Obviously, the first term on the right-hand side of Eq. (|^) pictures the total response from its own internal units. 

The second term expresses the interaction of the summation of the received signals from the neurons with the same 
position in two networks. The parameter e G [0,1] named as coupling intensity, describes the interaction degree 
between coupling subsystems. When the intensity £ <C 1, it is easy to see that the coupling sub-systems evolute 
independently. On the other limit case, e « 1, the coupling subsystems are governed by the same dynamical law and 
will be synchronized very easily. 

For measuring the coherence in the collective activity of the neural systems, a time-dependent important feature 



(t) = J2k=i (^) fo'^ each network i = 1, 2 is introduced. When the global coupling of two systems is absent, e « 0, 
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the Ui(t) will update independently and impossibly get to synchronization since the initial conditions in subsystems 
are different. On the other hand, the activity signals of two subsystems will be identical if the coupling systems come 
to be synchronous. Figure 1 (a) shows that the synchronization for this extend system successfully takes place in 
t — 275 for systems with N = 100, while the coupling intensity e = 0.34 and the linking degree in each subsystem 
d = 0.2. 

To show the degree of synchronization in this coupling system, the dispersion of activity patterns is defined as 

2 N 

1=1 k=l 

where Xk (t) = 2~^ Y^^=i (0 denotes the average activity of neurons occupying the fc-th position in both subsystems 
at time t. Figure 1 (6) shows that the dispersion with a logarithmic scale evolves in time with the same synchronous 
conditions in Fig. 1 (a). 

It is obvious that the larger coupling intensity e makes the more easily synchronization arises for the system with 
the same other parameters. Concomitantly, the case is whether there exists a critical coupling parameter Sc, and 
furthermore, whether there exists a dependent relationship between Sc and the topological structure in subsystems. 
In fact, since the evolution of networks is sensitive to the varied initial status and the different random connecting 
weight matrix in system with the same linking degree d, it is impossible to find an identical value of Be- However, the 
fact that the dispersion for these Sc corresponding to varied initial status and connecting matrices from our simulations 
is small brings our notice to investigate the qualitative curve of Sc vs. d. 

Figure 2 (a) shows a plot of the critical coupling intensity Sc versus the linking degree d in subsystems with the 
size N — 200. One can see that the qualitative relation between Sc and d is close to a sigmoidal curve. The larger d 
arise, the larger Sc become. This can be explained that the evolution of subsystems with larger d is more stable and 
it needs more powerful coupling parameter to drive their evolutions into synchronization. In Fig. 2 (6), we present 
the plot of simulation with the stepsize of linking degree Ad = 0.001 in the same conditions of Fig. 2 (a). Comparing 
both plots of simulations, the agreement is excellent for the global tendency of the qualitative behavior of Ec versus d. 

From Fig. 3, it follows that it is more difficult to come into synchronization with the increase of the size of 
subsystems. It is clear, however, that there exists a homologous asymptotic behavior in the area of larger linking 
degree. Now, the case is how the limit of coupling intensity depends on varied size of networks. In Fig. 4, we present 
the plot of Ec versus 1/N for the linking degree d = 1 which is identical to the limit case. The form of the limit 
coupling intensity as a function of the inverse of size of networks calls for a fitting of these data with a exponential 
decay function 

ee = A + i3e-i/(^*^) (4) 

where the constant A = 0.44 ±0.024, B = 0.44 ±0.020 and C 0.0066 ± 0.00071. It follows that the maximal critical 
coupling intensity corresponding to TV — > oo is set as 0.88 ± 0.044, and vice versa, the minimal Ec is 0.44 ± 0.024 if 
both global connecting subsystems designed by Eq. (|l|) can be come to synchronization. 

Another important topic is the fraction of coupling neurons between two subsystems. The considered coupling 
system can be viewed as a structure made of two horizontal layers of networks. Apparently, from the definition Eq. 
(|l|) of the above investigated systems, the neurons are involved in global vertical coupling interactions between two 
layers, or the dimensionality of coupling parameter is identical to the size of subsystems. Considering the real physical 
systems or the potential applications, the coupling interactions must be diluted and modified with time. As a result, 
the systems defined by Eq. (Q) can be redefined as 

xj (i + 1) = (1 - EC^ (t)) e (hj (t)) + it) e (h] it) + m 
xj (i + 1) = (1 - ee. {t)) e Ihi [t)) + eu [t) e [h] it) + hf {t)) 

where (<) G {0, 1} is a random number with probability 1 — p and p, respectively. 

For revealing the association between the critical coupling fraction pc and the coupling intensity £, the qualitative 
diagram of Pc versus e, is shown based on numerical simulations for systems with N — 100, d — 0.5 (see figure 5 (a)). 
It is easy to get an acceptable conclusion that pc decreases with the increase of e . Note that the series of turning 
points corresponding to Pc = 1 in Fig. 5 (6) are equivalent to the points in plot of Ec versus d (cf. Fig. 3). 

In addition, another valuable informations about the minimal critical fraction for synchronization of this extend 
system denoted by Eq. (||) can be revealed from another critical point at e = 1 in Fig. 5(a) and Fig. 5(6). In 
Fig. (6), the minimal critical coupling probability for various linking degree of subsystem with N — 400 is presented. 
During the evolution of networks, the neuron of each site in both networks updates due to the competing effect of the 
local rules and the coupling mechanism. It is clear that the region above the curve is the synchronization part, while 
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the lower part is desynchronizatious, thus the curve embodies a competing relationship between local correlation 
and stochastic coupling. It is possible to give the minimal critical coupling fraction for various linking degree in 
synchronization of this extended system with N ^ oo , which is more analogous to the case of real biotic systems, 
through analyzing curves of Pc vs. d for various size of subsystem. However, considering our computational device, 
the more intensive and detail work is left out in there. 

In this paper, we have studied the critical features of coupling parameter in the synchronization of neural networks for 
various structural topology. We obtain the exponential decay form in the case of global coupling among subsystems 
and fully linking in each network. We find that it exists the maximal and minimal critical coupling intensity for 
synchronization in this extend systems. For the case of partial coupling, a primary result about the critical coupling 
fraction for various linking degrees of networks is shown. Considering the definition of our model is analogous to 
coupled map lattice, it is easy to generalize the present work to other extended systems, such as coupled ordinary 
differential equations and partial differential equations. 
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FIG. 1. The synchronization of diluted networks with N = 100, e = 0.34 and d = 0.2. (a) The evolution of 
time-dependent activity of both subsystems comes into synchronization at f = 275. (b) logarithm of dispersion of 

both networks. 

FIG. 2. The simulations of relationship between the critical coupling parameter £c and the linking degree d with 
A'' = 200, corresponding to stepsize of linking degree (a) Ad = 0.05 and (b) Ad = 0.001. 

FIG. 3. The qualitative relationship of Sc versus d for varied size of networks A''. 

FIG. 4. The plot of Ec versus 1/A'' for varied size of networks in the limit case d=l. The exponential decay fitted 
curve of this relationship is shown by a dotted line. 

FIG. 5. The synchronization diagram of minimal coupling probability versus the corresponding coupling intensity 
e, (a)for systems with size N = 100, d = 0.5 (b) for systems with varied linking degree d and = 100 in the forms 
of qualitative curves. 

FIG. 6. The qualitative relationship of Pc versus d with the subsystem size A^ = 400. 
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